Temporal structure analysis of broadcast tennis video using hidden Markov models
نویسندگان
چکیده
This work aims at recovering the temporal structure of a broadcast tennis video from an analysis of the raw footage. Our method relies on a statistical model of the interleaving of shots, in order to group shots into predefined classes representing structural elements of a tennis video. This stochastic modeling is performed in the global framework of Hidden Markov Models (HMMs). The fundamental units are shots and transitions. In a first step, colors and motion attributes of segmented shots are used to map shots into 2 classes: game (view of the full tennis court) and not game (medium, close up views, and commercials). In a second step, a trained HMM is used to analyze the temporal interleaving of shots. This analysis results in the identification of more complex structures, such as first missed services, short rallies that could be aces or services, long rallies, breaks that are significant of the end of a game and replays that highlight interesting points. These higher-level unit structures can be used either to create summaries, or to allow nonlinear browsing of the video.
منابع مشابه
Recognizing Strokes in Tennis Videos using Hidden Markov Models
This paper addresses content-based video retrieval with an emphasis on recognizing events in tennis game videos. In particular, we aim at recognizing different classes of tennis strokes using automatic learning capability of Hidden Markov Models. Driven by our domain knowledge, a robust player segmentation algorithm is developed for real video data. Further, we introduce a number of novel featu...
متن کاملHMM based structuring of tennis videos using visual and audio cues
This paper focuses on the use of Hidden Markov Models (HMMs) for structure analysis of videos, and demonstrates how they can be efficiently applied to merge audio and visual cues. Our approach is validated in the particular domain of tennis videos. The basic temporal unit is the video shot. Visual features are used to characterize the type of shot view. Audio features describe the audio events ...
متن کاملTracking the Evolution of a Tennis Match Using Hidden Markov Models
The creation of a cognitive perception systems capable of inferring higher-level semantic information from low-level feature and event information for a given type of multimedia content is a problem that has attracted many researchers’ attention in recent years. In this work, we address the problem of automatic interpretation and evolution tracking of a tennis match using standard broadcast vid...
متن کاملSegmental-Based Modeling of Tennis Video Broadcasts
Automatic annotation of video documents is a powerful tool for managing large video databases. In this work we aim to describe tennis video broadcasts in a human meaningful way and thus to construct their table of contents. We present a generalization of Hidden Markov Models, the Segment Models, for modeling and extracting high-level information from a video sequence. Segment Models, even thoug...
متن کاملJoint modality fusion and temporal context exploitation for semantic video analysis
In this paper, a multi-modal context-aware approach to semantic video analysis is presented. Overall, the examined video sequence is initially segmented into shots and for every resulting shot appropriate color, motion and audio features are extracted. Then, Hidden Markov Models (HMMs) are employed for performing an initial association of each shot with the semantic classes that are of interest...
متن کامل